Papers with Cross-Modal Knowledge Synthesis mechanism
MAFMO: Multi-modal Adaptive Fusion with Meta-template Optimization for Vision-Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches focus on single-modality adjustments, leading to suboptimal alignment and limited generalization. |
| Approach: | They propose a plug-and-play framework for visual recognition that integrates a Harmonic Cross-Modal Adapter and a Meta-Template Optimization module. |
| Outcome: | Extensive experiments across multiple fine-grained visual recognition benchmarks show that MAFMO consistently improves existing methods’ performance on both novel classes and harmonic mean while maintaining robustness under various challenging conditions with minimal computational overhead. |